Boosting Semi-Supervised Semantic Segmentation with Probabilistic Representations

نویسندگان

چکیده

Recent breakthroughs in semi-supervised semantic segmentation have been developed through contrastive learning. In prevalent pixel-wise learning solutions, the model maps pixels to deterministic representations and regularizes them latent space. However, there exist inaccurate pseudo-labels which map ambiguous of wrong classes due limited cognitive ability model. this paper, we define from a new perspective probability theory propose Probabilistic Representation Contrastive Learning (PRCL) framework that improves representation quality by taking its into consideration. Through modelling mapping as via multivariate Gaussian distributions, can tune contribution tolerate risk pseudo-labels. Furthermore, prototypes form indicates confidence class, while point prototype cannot. More- over, regularize distribution variance enhance reliability representations. Taking advantage these benefits, high-quality feature be derived space, thereby performance se- mantic further improved. We conduct sufficient experiment evaluate PRCL on Pascal VOC CityScapes demonstrate superiority. The code is available at https://github.com/Haoyu-Xie/PRCL.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Transferable Semi-supervised Semantic Segmentation

The performance of deep learning based semantic segmentation models heavily depends on sufficient data with careful annotations. However, even the largest public datasets only provide samples with pixel-level annotations for rather limited semantic categories. Such data scarcity critically limits scalability and applicability of semantic segmentation models in real applications. In this paper, ...

متن کامل

Adversarial Learning for Semi-Supervised Semantic Segmentation

We propose a method 1 for semi-supervised semantic segmentation using the adversarial network. While most existing discriminators are trained to classify input images as real or fake on the image level, we design a discriminator in a fully convolutional manner to differentiate the predicted probability maps from the ground truth segmentation distribution with the consideration of the spatial re...

متن کامل

SERBoost: Semi-supervised Boosting with Expectation Regularization

The application of semi-supervised learning algorithms to large scale vision problems suffers from the bad scaling behavior of most methods. Based on the Expectation Regularization principle, we propose a novel semi-supervised boosting method, called SERBoost that can be applied to large scale vision problems. The complexity is mainly dominated by the base learners. The algorithm provides a mar...

متن کامل

Decoupled Deep Neural Network for Semi-supervised Semantic Segmentation

We propose a novel deep neural network architecture for semi-supervised semantic segmentation using heterogeneous annotations. Contrary to existing approaches posing semantic segmentation as a single task of region-based classification, our algorithm decouples classification and segmentation, and learns a separate network for each task. In this architecture, labels associated with an image are ...

متن کامل

Semi and Weakly Supervised Semantic Segmentation Using Generative Adversarial Network

Semantic segmentation has been a long standing challenging task in computer vision. It aims at assigning a label to each image pixel and needs significant number of pixellevel annotated data, which is often unavailable. To address this lack, in this paper, we leverage, on one hand, massive amount of available unlabeled or weakly labeled data, and on the other hand, non-real images created throu...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2023

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v37i3.25396